Unfortunately it's much more limited than an actual "dumb phone" because of some weird choices Apple made. In particular:

1. You can only receive messages from numbers that are in your contact list.

2. You can only send messages and make phone calls to select numbers that are in your contact list, and which have been additionally whitelisted under Assistive Access.

3. The Settings app (which lets you configure the whitelist) is not available.